Measurement bias in caregiver-report of early childhood behavior problems across demographic factors in an ECHO-wide diverse sample.

Background: Research and clinical practice rely heavily on caregiver-report measures, such as the Child Behavior Checklist 1.5-5 (CBCL/1.5-5), to gather information about early childhood behavior problems and to screen for child psychopathology. While studies have shown that demographic variables influence caregiver ratings of behavior problems, the extent to which the CBCL/1.5-5 functions equivalently at the item level across diverse samples is unknown. Methods: Item-level data of CBCL/1.5-5 from a large sample of young children (N = 9087) were drawn from 26 cohorts in the Environmental influences on Child Health Outcomes program. Factor analyses and the alignment method were applied to examine measurement invariance (MI) and differential item functioning (DIF) across child (age, sex, bilingual status, and neurodevelopmental disorders), and caregiver (sex, education level, household income level, depression, and language version administered) characteristics. Child race was examined in sensitivity analyses. Results: Items with the most impactful DIF across child and caregiver groupings were identified for Internalizing, Externalizing, and Total Problems. The robust item sets, excluding the high DIF items, showed good reliability and high correlation with the original Internalizing and Total Problems scales, with lower reliability for Externalizing. Language version of CBCL administration, education level and sex of the caregiver respondent showed the most significant impact on MI, followed by child age. Sensitivity analyses revealed that child race has a unique impact on DIF over and above socioeconomic status. Conclusions: The CBCL/1.5-5, a caregiver-report measure of early childhood behavior problems, showed bias across demographic groups. Robust item sets with less DIF can measure Internalizing and Total Problems equally as well as the full item sets, with slightly lower reliability for Externalizing, and can be crosswalked to the metric of the full item set, enabling calculation of normed T scores based on more robust item sets.

Prediction of internalizing and externalizing symptoms in late childhood from attention-deficit/hyperactivity disorder symptoms in early childhood.

Limited analyses based on national samples have assessed whether early attention-deficit/hyperactivity disorder (ADHD) symptoms predict later internalizing and externalizing symptoms in youth and the influence of sex and pubertal timing on subsequent psychiatric symptoms. This study analyzed data (n = 2818) from the Environmental influences on Child Health Outcomes Program national cohort. Analyses used data from early childhood (mean age = 5.3 years) utilizing parent-reported ADHD symptoms to predict rates of internalizing and externalizing symptoms from late childhood/adolescence (mean age = 11.9 years). Within a subsample age at peak height velocity (APHV) acted as a proxy to assess pubertal timing from early childhood (mean age = 5.4 years) to adolescence (mean age = 12.3 years). Early-childhood ADHD symptoms predicted later psychiatric symptoms, including anxiety, depression, aggressive behavior, conduct problems, oppositional defiant disorder, and rule-breaking behavior. Earlier APHV was associated with increased Conduct Disorder symptoms from late childhood to adolescence for females only. A stronger relation between ADHD symptoms and later aggression was observed in females with earlier APHV, whereas this same pattern with aggression, conduct problems and depression was observed in males with later APHV. Clinicians should consider that both young girls and boys with elevated ADHD symptoms, particularly with off-set pubertal timing, may be at risk for later psychiatric symptoms.

Development of the PROMIS pediatric stigma and extension to the PROMIS pediatric stigma: skin item banks.

PURPOSE: To develop the PROMIS Pediatric Stigma (PPS) and Skin (PPS-Skin) by constructing a common metric for measuring stigma in children with various conditions, while capturing the unique features of each condition. METHODS: Data from 860 children, ages 8-17, with a diagnosis of epilepsy, pNF (neurofibromatosis type 1 associated neurofibroma plexform), MD (muscular dystrophy), cancer, or skin conditions recruited from three projects were analyzed. Children with epilepsy, pNF and MD (sample-1) completed the original 18-item Neuro-QoL Stigma, while children with cancer and skin conditions (e.g., atopic dermatitis, psoriasis, and genetic skin disorders; sample-2) completed a 16-item version and 6 additional skin related items. Exploratory factor analysis (EFA) and confirmatory analysis (CFA) were used to evaluate unidimensionality of 24 stigma items. Differential item functioning (DIF) was used to evaluate measurement equivalence on group, gender, age, and conditions. Item response theory model (IRT) was used to construct the final measure. RESULTS: Sufficient unidimensionality was supported by both EFA and CFA. No items showed significant DIF indicating stable measurement properties across groups of comparison. All items fit the IRT model and were able to be calibrated together to form the PPS which consists of 18 core items. The PPS-Skin (18 cores items + 6 skin items) was developed by calibrating 6 skin items onto the common metric as the PPS. CONCLUSIONS: We used IRT techniques to successfully develop the PPS and the PPS-Skin, which share a common metric and account for unique and common concerns related to chronic conditions.

Assessing the interchangeability of linked scores in multivariable statistical analyses.

PURPOSE: Using the lens of classical test theory, we examine a linkage's generalizability with respect to use in multivariable analyses, including multiple regression and structural equation modeling, rather than comparison of established subpopulations as is most common in the literature. METHODS: To aid in this evaluation, we present a structural-equation-modeling based statistical method to examine the suitability of a given linkage for use cases involving continuous and categorical variables external to the linkage itself. RESULTS: Using the PROMIS® Parent Proxy and Early Childhood Global Health measures, we show that, although a high correlation between the scores (here, r = .829) may imply a general suitability for linking, a more detailed investigation of content, measurement structure, and results of the proposed methodology reveal important differences between the measures which can compromise interchangeability in certain use cases. CONCLUSION: In addition to the statistical quality of a linkage, users of linking methodology should also assess the question of whether the linkage is appropriate to apply to particular use cases of interest.

Life satisfaction for adolescents with developmental and behavioral disabilities during the COVID-19 pandemic.

BACKGROUND: This study aimed to identify contextual factors associated with life satisfaction during the COVID-19 pandemic for adolescents with mental, emotional, behavioral, and developmental (MEBD) disabilities. METHODS: Data were collected from a sample of 1084 adolescents aged 11-21 years from April 2020 to August 2021. This cross-sectional study used a sequential machine learning workflow, consisting of random forest regression and evolutionary tree regression, to identify subgroups of adolescents in the Environmental influences on Child Health Outcomes (ECHO) consortium who demonstrated enhanced vulnerability to lower life satisfaction as described by intersecting risk factors, protective factors, and MEBD disabilities. RESULTS: Adolescents with a history of depression, anxiety, autism, and attention-deficit/hyperactivity disorder were particularly susceptible to decreased life satisfaction in response to unique combinations of stressors experienced during the COVID-19 pandemic. These stressors included decreased social connectedness, decreased family engagement, stress related to medical care access, pandemic-related traumatic stress, and single-caregiver households. CONCLUSION: Findings from this study highlight the importance of interventions aimed specifically at increasing adolescent social connectedness, family engagement, and access to medical support for adolescents with MEBD disabilities, particularly in the face of stressors, such as a global pandemic. IMPACT: Through a machine learning process, we identified contextualized risks associated with life satisfaction among adolescents with neurodevelopmental disabilities during the COVID-19 pandemic. The COVID-19 pandemic resulted in large-scale social disruptions for children and families. Such disruptions were associated with worse mental health outcomes in the general pediatric population, but few studies have examined specific subgroups who may be at heightened risk. We endeavored to close that gap in knowledge. This study highlights the importance of social connectedness, family engagement, and access to medical support as contributing factors to life satisfaction during the COVID-19 pandemic for adolescents with neurodevelopmental disabilities.

Caregiver Perceived Stress and Child Sleep Health: An Item-Level Individual Participant Data Meta-Analysis.

Up to 50% of children and adolescents in the United States (U.S.) experience sleep problems. While existing research suggests that perceived stress in caregivers is associated with poorer sleep outcomes in children, research on this relationship is often limited to infant and early childhood populations; therefore, we investigated this association in school-age children and adolescents. We used cross-sectional caregiver-reported surveys and applied item response theory (IRT) followed by meta-analysis to assess the relationship between caregiver perceived stress and child sleep disturbance, and moderation of this relationship by child age and the presence of a child mental or physical health condition. We analyzed data from the National Institutes of Health (NIH) Environmental influences on Child Health Outcomes (ECHO) Program, a collaboration of existing pediatric longitudinal cohort studies that collectively contribute a diverse and large sample size ideal for addressing questions related to children's health and consolidating results across population studies. Participants included caregivers of children ages 8 to 16 years from four ECHO cohorts. Caregiver perceived stress was measured using the Perceived Stress Scale (PSS), and child sleep disturbance was assessed using five sleep-related items from the School-Age version of the Child Behavior Checklist (CBCL). Increases in caregiver perceived stress and child mental or physical health condition were independently associated with greater sleep disturbance among children. The findings reinforce the importance of accounting for, and potentially intervening on, the broader family context and children's mental and physical health in the interest of improving sleep health.

Linking the Perceived Stress Scale to the PROMIS Psychological Stress Experiences-Pediatric in adolescents.

The Perceived Stress Scale (PSS) and PROMIS Psychological Stress Experiences-Pediatric (PPSE) are two self-report instruments that have been used with adolescents to measure subjective feelings of stress. Stress is a critical construct to evaluate, as chronic stress can result in negative long-term consequences for an individual's physical and mental health. While the PSS is more commonly used in research and clinical practice, use of the PPSE is becoming more widespread. This increased usage necessitates a way to compare the measures, for example, when changing which instrument is used in practice or when combining data from the two measures in pooled analysis. After assessing linking assumptions, we used equipercentile linking to score-link the two measures on the raw score and T-score metrics for both longer forms (10 PSS items; 8 PPSE items) and shorter forms (4 PSS or PPSE items), yielding crosswalk tables (Open Science Framework: https://osf.io/9pzyk/) to convert scores on each measure to the metric of the other. Raw scores between measures (.670 ≤ r ≤ .794) were not sufficiently correlated for score linking. Therefore, linked scores were treated as predictions, rather than counterfactual values on the alternative measure. Further, confirmatory factor analyses revealed that this low correlation was primarily due to the low reliability and multidimensionality of the PSS, and the derived linking functions were found to have minimal bias. Recommendations for the use of these conversion tables by researchers and practitioners are provided. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Prenatal Substance Exposure: Associations with Neurodevelopment in Middle Childhood.

OBJECTIVE: Single-substance exposure effects on neurodevelopmental outcomes, such as problem behavior and intelligence quotient (IQ), have been studied in children for decades. However, the long-term consequences of polysubstance exposure are poorly understood. STUDY DESIGN: Longitudinal neurodevelopmental data were gathered from cohorts across the United States through the Environmental Influences on Child Health Outcomes Program. Data on prenatal exposure to opioids, nicotine, marijuana, and alcohol were collected from children ages 6 to 11 years (N = 256). Problem behavior was assessed using the Child Behavior Checklist (school-age version), and verbal IQ (VIQ) and performance IQ (PIQ) were assessed using the Weschler Intelligence Scale for Children, Fifth Edition. We first identified latent profiles in the overall sample, then evaluated differences in profile membership for children with and without prenatal substance exposure. RESULTS: Latent profile analysis identified two mutually exclusive categories: average VIQ and PIQ, with typical problem behavior, and below-average VIQ with average PIQ and clinically significant problem behavior. Children with prenatal nicotine and polysubstance exposures were more likely to be classified in the below-average VIQ, elevated problem behavior profile compared with children without prenatal nicotine exposure. CONCLUSION: The presence of clinically significant behavior problems in children with average PIQ, but below-average VIQ, could represent a unique endophenotype related to prenatal nicotine exposure in the context of other prenatal substance exposures. KEY POINTS: · The neurodevelopmental consequences of prenatal polysubstance exposure are poorly understood.. · Children with prenatal polysubstance exposure exhibited reduced IQ and elevated problem behavior.. · We found significant behavior problems in children with average PIQ and below-average VIQ.. · This may represent a unique endophenotype related to prenatal nicotine exposure..

Latent Class Analysis of Prenatal Substance Exposure and Child Behavioral Outcomes.

OBJECTIVES: To predict behavioral disruptions in middle childhood, we identified latent classes of prenatal substance use. STUDY DESIGN: As part of the Environmental influences on Child Health Outcomes Program, we harmonized prenatal substance use data and child behavior outcomes from 2195 women and their 6- to 11-year-old children across 10 cohorts in the US and used latent class-adjusted regression models to predict parent-rated child behavior. RESULTS: Three latent classes fit the data: low use (90.5%; n = 1986), primarily using no substances; licit use (6.6%; n = 145), mainly using nicotine with a moderate likelihood of using alcohol and marijuana; and illicit use (2.9%; n = 64), predominantly using illicit substances along with a moderate likelihood of using licit substances. Children exposed to primarily licit substances in utero had greater levels of externalizing behavior than children exposed to low or no substances (P = .001, d = .64). Children exposed to illicit substances in utero showed small but significant elevations in internalizing behavior than children exposed to low or no substances (P < .001, d = .16). CONCLUSIONS: The differences in prenatal polysubstance use may increase risk for specific childhood problem behaviors; however, child outcomes appeared comparably adverse for both licit and illicit polysubstance exposure. We highlight the need for similar multicohort, large-scale studies to examine childhood outcomes based on prenatal substance use profiles.

A true score imputation method to account for psychometric measurement error.

Scores on self-report questionnaires are often used in statistical models without accounting for measurement error, leading to bias in estimates related to those variables. While measurement error corrections exist, their broad application is limited by their simplicity (e.g., Spearman's correction for attenuation), which complicates their inclusion in specialized analyses, or complexity (e.g., latent variable modeling), which necessitates large sample sizes and can limit the analytic options available. To address these limitations, a flexible multiple imputation-based approach, called true score imputation, is described, which can accommodate a broad class of statistical models. By augmenting copies of the original dataset with sets of plausible true scores, the resulting set of datasets can be analyzed using widely available multiple imputation methodology, yielding point estimates and confidence intervals calculated with respect to the estimated true score. A simulation study demonstrates that the method yields a large reduction in bias compared to treating scores as measured without error, and a real-world data example is further used to illustrate the benefit of the method. An R package implements the proposed method via a custom imputation function for an existing, commonly used multiple imputation library (mice), allowing true score imputation to be used alongside multiple imputation for missing data, yielding a unified framework for accounting for both missing data and measurement error. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Sleep-related items on the school-age CBCL and the PROMIS sleep disturbance 4-item short-form: A psychometric comparison from the Environmental Influences on Child Health Outcomes (ECHO) program.

The Child Behavior Checklist (CBCL) parent-report school-age form, a broad instrument widely used to evaluate youth's emotional and behavioral functioning, includes seven sleep-related items. These items are not an official subscale of the CBCL, but researchers have used them as a measure of general sleep problems. The primary objective of the present study was to evaluate the construct validity of the CBCL sleep items with a validated measure of sleep disturbance, the Patient-Reported Outcomes Measurement Information System Parent Proxy Short Form-Sleep Disturbance 4a (PSD4a). To do so, we used coadministered data on the two measures from 953 participants ages 5-18 years in the National Institutes of Health Environmental influences on Child Health Outcomes research program. Exploratory factor analysis (EFA) revealed two CBCL items were strictly jointly unidimensional with the PSD4a. To help prevent floor effects, we conducted further analyses that revealed three additional CBCL items could be included as an ad hoc measure of sleep disturbance. However, the PSD4a remains a psychometrically superior measure of child sleep disturbance. Researchers using these CBCL items to measure child sleep disturbance should account for these psychometric issues in their analysis and/or interpretation. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Prenatal Antidepressant Exposures and Autism Spectrum Disorder or Traits: A Retrospective, Multi-Cohort Study.

Prenatal antidepressant exposure has been associated with increased risk for neurodevelopmental disorders in childhood, including autism spectrum disorder (ASD). The current study utilized multi-cohort data from the Environmental influences on Child Health Outcomes (ECHO) program (N = 3129) to test for this association, and determine whether the association remained after adjusting for maternal prenatal depression and other potential confounders. Antidepressants and a subset of selective serotonin reuptake inhibitors (SSRIs) were examined in relation to binary (e.g., diagnostic) and continuous measures of ASD and ASD related traits (e.g., social difficulties, behavior problems) in children 1.5 to 12 years of age. Child sex was tested as an effect modifier. While prenatal antidepressant exposure was associated with ASD related traits in univariate analyses, these associations were statistically non-significant in models that adjusted for prenatal maternal depression and other maternal and child characteristics. Sex assigned at birth was not an effect modifier for the prenatal antidepressant and child ASD relationship. Overall, we found no association between prenatal antidepressant exposures and ASD diagnoses or traits. Discontinuation of antidepressants in pregnancy does not appear to be warranted on the basis of increased risk for offspring ASD.

Youth Well-being During the COVID-19 Pandemic.

OBJECTIVES: The family stress model proposes economic hardship results in caregiver distress and relational problems, which negatively impact youth outcomes. We extend this model to evaluate the impact of coronavirus disease 2019 pandemic-related family hardships on caregiver and youth stress, and, in turn, youth's psychological well-being. We also investigate how social supports moderate this relationship. METHODS: We used 2 samples of cross-sectional survey data collected between May 2020 and May 2021: children aged 2 to 12 years (n = 977) and adolescents aged 11 to 17 years (n = 669). Variables included pandemic-related family hardships, stress, social support, and youth life satisfaction. Data were analyzed using structural equation modeling. RESULTS: Experiencing more pandemic-related family hardships was associated with increased caregiver and youth stress (b = 0.04 to 0.21, SE = 0.01-0.02) and, in turn, decreased youth life satisfaction (b = -0.36 to -0.38, SE = 0.04-0.07). Social connectedness (b^ = 0.11-0.17, SE = 0.04) and family engagement (b^ = 0.12-0.18, SE = 0.05-0.06) had direct positive associations with life satisfaction; for children aged 2 to 12 years, greater family engagement was associated with decreased effect of child stress on life satisfaction (b^ = 0.15, SE = 0.05). For adolescents, females had higher levels of stress compared with males (b^ = 0.40, SE = 0.6), and having anxiety and/or depression was associated with decreased life satisfaction (b^ = -0.24, SE = 0.11). CONCLUSIONS: Caregivers and youth who experienced more coronavirus disease 2019 pandemic hardships had higher levels of stress, particularly adolescent females. Although stress negatively impacted life satisfaction across all ages, family engagement was a protective factor for children aged 2 to 12 years, whereas having anxiety and/or depression was a risk factor for adolescents. For all youth, however, being more socially connected and engaged with family promoted life satisfaction.

Linking the Child Behavior Checklist to the Strengths and Difficulties Questionnaire.

The Child Behavior Checklist (CBCL) and Strengths and Difficulties Questionnaire (SDQ) both measure emotional and behavioral problems in children and adolescents, and scores on the two instruments are highly correlated. When administrative needs compel practitioners to change the instrument used or data from the two measures are combined to perform pooled analyses, it becomes necessary to compare scores on the two instruments. To enable such comparisons, we score linked three domains (Internalizing, Externalizing, and Total Problems) of the CBCL and SDQ in three age groups spanning 2-17 years. After assessing linking assumptions, we compared item response theory (IRT) and equipercentile linking methods to identify the most statistically justifiable link, ultimately selecting equipercentile linking with loglinear smoothing due to its minimal bias and the ability to link raw SDQ scores with both T-scores and raw scores from the CBCL. We derived crosswalk conversion tables to convert scores on one measure to the metric of the other and discuss the use of these tables in research and practice. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Extensions of Multiple-Group Item Response Theory Alignment: Application to Psychiatric Phenotypes in an International Genomics Consortium.

Large-scale studies spanning diverse project sites, populations, languages, and measurements are increasingly important to relate psychological to biological variables. National and international consortia already are collecting and executing mega-analyses on aggregated data from individuals, with different measures on each person. In this research, we show that Asparouhov and Muthén's alignment method can be adapted to align data from disparate item sets and response formats. We argue that with these adaptations, the alignment method is well suited for combining data across multiple sites even when they use different measurement instruments. The approach is illustrated using data from the Whole Genome Sequencing in Psychiatric Disorders consortium and a real-data-based simulation is used to verify accurate parameter recovery. Factor alignment appears to increase precision of measurement and validity of scores with respect to external criteria. The resulting parameter estimates may further inform development of more effective and efficient methods to assess the same constructs in prospectively designed studies.

A multiple imputation score test for model modification in structural equation models.

Structural equation modeling (SEM) applications routinely employ a trilogy of significance tests that includes the likelihood ratio test, Wald test, and score test or modification index. Researchers use these tests to assess global model fit, evaluate whether individual estimates differ from zero, and identify potential sources of local misfit, respectively. This full cadre of significance testing options is not yet available for multiply imputed data sets, as methodologists have yet to develop a general score test for this context. Thus, the goal of this article is to outline a new score test for multiply imputed data. Consistent with its complete-data counterpart, this imputation-based score test provides an estimate of the familiar expected parameter change statistic. The new procedure is available in the R package semTools and naturally suited for identifying local misfit in SEM applications (i.e., a model modification index). The article uses a simulation study to assess the performance (Type I error rate, power) of the proposed score test relative to the score test produced by full information maximum likelihood (FIML) estimation. Due to the two-stage nature of multiple imputation, the score test exhibited slightly lower power than the corresponding FIML statistic in some situations but was generally well calibrated. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Ecological validity of a quantitative classification system for mental illness in treatment-seeking adults.

Quantitative models of mental illness, such as the Hierarchical Taxonomy of Psychopathology (HiTOP), aim to optimize clinical assessment, which conventionally follows categorical diagnostic rubrics. The evidence base for these models is robust, but also uniform; available data come mostly from structured diagnostic interviews in nationally representative samples. It remains to be seen whether HiTOP adequately reflects mental illness as evaluated in routine clinical care, where diagnosis is often unsystematic and incomplete, relative to controlled research conditions. To test the generalizability of a quantitative nosology to real-world assessment contexts, we fit the HiTOP model to diagnoses in a large sample (N = 25,002) of treatment-seeking university students who were seen by health professionals in everyday practice. We then examined the criterion validity of model components in relation to clinically relevant outcomes (i.e., suicide attempts, self-injury, and binge drinking). Three related structures fit the data well: a correlated-factor model with internalizing, externalizing, and eating pathology dimensions; a higher-order model that added a general factor of psychopathology that spanned these 3 first-order factors; and a bifactor model that partitioned diagnostic (co)variance across a general factor and 3 orthogonal group factors. The first-order factors had expected patterns of criterion validity, and the general factor was a strong predictor of suicidality and self-injury, paralleling past research. Bifactor model group factors had interpretative problems, however. Across models, categorical diagnoses consistently offered minimal incremental validity relative to the transdiagnostic factors. We conclude that HiTOP is ecologically valid-explaining comorbidity patterns among diagnoses assigned "in the field"-and is poised to enhance clinical assessment and decision-making in routine care. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Pregnancy anxiety predicts shorter gestation in Latina and non-Latina white women: The role of placental corticotrophin-releasing hormone.

OBJECTIVE: Previous research has shown that a woman's anxiety about her pregnancy predicts gestational length. Placental corticotrophin-releasing hormone (CRH) is a stress-responsive peptide proposed as a mechanism. We examined placental CRH as a physiological mediator of the association between pregnancy anxiety and gestational length in Latina and non-Latina White women to replicate evidence of associations between pregnancy anxiety, placental CRH and gestational length; to test whether placental CRH levels or changes mediate effects of pregnancy anxiety on gestational length; to examine ethnic differences in pregnancy anxiety, placental CRH, and gestational length; and to explore whether the effects of pregnancy anxiety on gestational length as mediated by placental CRH vary by ethnicity. METHODS: In a prospective study of 337 pregnant Latina and non-Latina White women, participants completed in-person interviews that included a 10-item measure of pregnancy anxiety and provided blood samples assayed using radioimmunoassay at three timepoints (19, 25, and 31 weeks gestation). RESULTS: Pregnancy anxiety at 19 and 31 weeks and levels of placental CRH at 31 weeks predicted gestational length. Tests of indirect effects were consistent with mediation such that both pregnancy anxiety at 19 weeks and increases from 19 to 31 weeks predicted placental CRH at 31 weeks, which in turn predicted gestational length. Tests of moderated mediation by ethnicity showed that the mediated effect of placental CRH at 31 weeks was significant for Latinas only. CONCLUSIONS: These findings add to growing evidence of the involvement of pregnancy anxiety in the timing of birth, address mechanisms, and suggest possible ethnic differences.